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Abstract 

Braman JJJ described a construction where third-order tensors are exactly the set of linear 
transformations acting on the set of matrices with vectors as scalars. This extends the familiar 
notion that matrices form the set of all linear transformations over vectors with real-valued 
•^T ■ scalars. This result is based upon a circulant-based tensor multiplication due to Kilmer et al. B . 

In this work, we generalize these observations further by viewing this construction in its natural 
framework of group rings. The circulant-based products arise as convolutions in these algebraic 
structures. Our generalization allows for any abelian group to replace the cyclic group, any 
commutative ring with identity to replace the field of real numbers, and an arbitrary order tensor 
to replace third-order tensors, provided the underlying ring is commutative. 

Keywords: Multilinear algebra, tensor, convolution, module, group ring. 

^" . 1 Introduction 

o\ 
oo 

Matrix multiplication is an example of a contracted product between two second-order tensors. 
Namely, for two matrices A = {aij) and B = (bjk), where A,B£ W nxn , their product C = AB 
O ' is defined as 

Cik = '^2a ij b jk , or simply c ik = a i: jb jk . (1) 

3 

The latter notation was attributed to Einstein, where a summation is implied whenever two indices 
appear exactly twice. With this notation, the inner product of two vectors u = (uj) and v = (vj) 
is denoted by UjVj and the matrix- vector product of A and u is denoted by aijUj. It is possible to 
extend this contracted product to higher-order tensors, but it lacks the closure property on odd-order 
tensors (as the example on vectors showed). So, it is not possible to define a tensor multiplication 
for odd-order tensors based on contracted product if we require the closure property. 

Recently, Kilmer et al. flU proposed an interesting tensor multiplication for third-order tensors 
based on circulant matrices. A standard Z„-circulant n x n matrix A (see J2]|) is defined completely 
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by its first row as ajj = ao,j-i = Oi-j> where subtraction is done modulo n: 



A = circ((ao, a%, 
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as a sequence of matrices .A = (Ak) and 23 = (Bk), 



\ Then, their circulant product C = A * B is given by 



Ai 



A n _i A n _2 
A A n „! 



.4 



n-l 



.4 



n-2 



.4 



n— 3 



ir 




" So ' 




' Co ' 


i 2 




Si 


= 


Ci 


V 




_Bn-l_ 




_Cn-i_ 



(3) 



where C = (C^) (viewed as a sequence of matrices) with Ck £ M nxn . This tensor multiplication has 
the important closure property lacking in a contracted product and allows a singular value decompo- 
sition to be defined easily for third-order tensors (see Hi). We note that C = (Ck) is simply the con- 
volution between the two matrix sequences A = (Ak) and B = (Bk), since Ck = J2 r +s=k A r S s . 
By viewing a matrix as a sequence of vectors, we can use the circulant-based tensor multiplication 
to define a tensor-matrix product similarly. 

A fundamental fact in linear algebra states that the set of n x n matrices is isomorphic to the set 
of linear transformations over the vector space W n . A matrix A linearly maps a vector u to another 
vector v through a matrix- vector product v = Au or V{ = aijUj, defined using a contracted 
product. This observation is difficult to generalize for odd-order tensors since the matrix-vector 
product does not map a vector space to itself. Building on the work in |@J, Braman [lj proved the 
following surprising property of third-order tensors: the set of all third-order tensors form precisely 
the set of linear transformations on a module (vector space over ring) defined by second-order 
tensors (matrices) with scalars from first-order tensors (vectors). In this sense, Braman's result 
recovered the fundamental isomorphism between matrices and linear transformations on a vector 
space (over a field). This answered one of the main questions posed in [5]: to characterize exactly 
the objects operated on by (third-order) tensors. 

Braman's construction relied on a set of carefully defined products between vectors (namely, 
a b), between vectors and matrices (namely, a o X), and also the circulant product between 
third-order tensors (namely, A*B) which also includes a product between third-order tensors and 
matrices (namely, A * X). Figure Q] contains a description of these products and their definitions 
in [H. Using these products, Braman proved that the set of matrices forms a unitary free module 
with scalars that are vectors. Moreover, any third-order tensor is a linear transformation over this 
module and any linear transformation over the module can be represented as a third-order tensor. 
An interesting diagonalization theorem for third-order tensors was also proved which recovers the 
eigenvalue-eigenvector equations for diagonalizable matrices. This answered another main question 
posed in @ : to determine the singular or eigenvalues of tensors and to see if these are possibly 
vectors rather than scalars. 

In this work, we generalize Braman's result HI in several ways. First, we show that all of the 
different products defined in the construction are, in fact, convolutions in various group rings. This 
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Notation: a, b are "vectors", X is a "matrix", A, B are "tensors". 

Figure 1: A comparison of tensor products defined by Braman 0]], which is based on circulant 
matrices, and our interpretation, which is based on convolutions in group rings. The ingredients in 
our construction are: an abelian group Q, a commutative ring R with identity, a group ring V = RQ, 
a matrix ring M = M n {R) (viewed also as a group ring YQ), and a group ring T = MQ. 



provides a unifying picture to Braman's construction on third-order tensors. Then, we extend the 
construction to arbitrary order tensors (beyond third-order) by viewing the set of tensors equipped 
with addition and convolution product as a (commutative) ring with identity. This extends previous 
constructions which defined the tensors over the field of real or complex numbers. Our generaliza- 
tion also allows the underlying circulant matrices to be generalized to any abelian group-theoretic 
circulant. Within our algebraic setting, we also identified Braman's clever choice of a basis for the 
unitary free module of matrices, which is not the natural basis for this group ring. Figure [Qdescribes 
the new interpretation in our framework of the tensor products used in (H. 

This paper is organized as follows. In Section |2l we describe relevant notation and algebraic 
background which will be used throughout. In Section [3 we provide a unifying view of Braman's 
construction by defining a tower of group rings which forms the natural setting for her construction. 
Some additional products which arise naturally from the tower of rings are described in Section I3TT1 
In Section|4l we prove that the set of matrices is a unitary free module under a special scalar product 
between vectors and matrices. In Section [2 we show that the set of tensors is isomorphic to the set 
of module homomorphisms over the set of matrices. Finally, in Section[6l we show that the module 
structure on tensors admits a particular form of tensor diagonalization. 

2 Preliminaries 

Notation The Kronecker delta <5,& is defined to be 1 if j = k and otherwise. We will adopt the 
convenient Dirac notation for matrices. Here, \k) will be used to denote a n x 1 matrix (column 
vector) which is one at position k and zero elsewhere. The corresponding lxn matrix (row vector) 
will be denoted as (k\. Thus, (j\X\k) denotes the (j, /c)-entry ofanxn matrix X. As is standard, 
the Dirac bracket (inner product) is (j\k) = 5j^ while the outer product \j){k\ is a matrix whose 
(j, A;)-entry is 1 and the other entries are zero. 



For a group Q and a ring R with identity 1r, the group ring RQ is the set of all formal sums 
Y2 £ g a g \g), where a g G R. Here, we use the notation \g) to denote a placeholder for the group 
element g, which may also be viewed as the unit vector which is one only at position indexed by g 
and zero elsewhere. If \g is the identity of Q and a G R, then a\\g) is simply written as a. Also, 
1r|#), for g G Q, is simply denoted by \g). The group ring RQ is a ring under component-wise 



Figure 2: The group ring basis {\g) : g G Z n } of V = R7L n . 



addition and convolution-like multiplication. More specifically, addition is defined as: 
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where we let (a\g)) * (b\h)) = (ab)\gh), for a, b G R and g,h £ G- This multiplication is simply a 
convolution (with respect to the group £?) between the "sequences" a and b. It is known that RQ is 
a commutative ring with identity if and only if R is commutative with identity and Q is abelian (see 
0, page 117). 

Let R be a ring with identity. A (left) R-module 93T is an abelian group together with a scalar 
multiplication o : R x 93T — > 931 which satisfies the following axioms. For any a, b G R and 
X, Y G 9J1, we have: 



ao(X + Y) 
(a + b) o X 
(a*b)oI 



aoX + ao Y 
aol + bol 
ao(bol). 



(6) 

(7) 
(8) 



The module 93T is called unitary if there is an element 1r G R so that 1r o X = X, for all X G STJt. 
93T is called a. free module if there is a linearly independent set 23 = {Bi, . . . , B r } C 931, so that 
any element X G 931 can be written as Ylk=i a k ° Bk, for some a& G R. Such a set 23 is called a 
basis for 93T. 

If Tli and 93?2 are modules over a ring R, a function i/> : 93Ti — )> 93T2 is an R-module homomor- 
phism if for all X, Y G SPTi and a G R: 



i/.(aoI) 



ao^(X). 



(9) 
(10) 



If R is a division ring, then ip is called a linear transformation (see 0). For a module 93t, we 
denote the set of all R-module homomorphisms from 931 to itself as honiR (931) (also called endo- 
morphisms). Note homR(93T) is a ring under component- wise addition and composition of maps. 

Fact 1 (Ribenboim [6]) For a commutative ring R with identity, a group ring RQ is unitary free 
module. A natural basis for RQ is {\g) : g G Q}, where \g) is shorthand for 1r|<?). 
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Figure 3: Tower of rings: the case when Q = Z n . 



3 Tower of rings 

We view Braman's construction (U in an algebraic framework involving group rings. 

1. Let Q be an abelian group Q of order n. 

The choice of Q determines the type of convolution or circulant used. A standard choice is 
the cyclic group Z ra of order n as used in El CD- 

2. Let R be a commutative ring with identity. 

This choice reflects the underlying algebraic ring structure and it generalizes the case where 
R = R is the field of real numbers. 

3. Let V be the group ring RQ. 

This is a commutative ring with identity whenever Q is an abelian group and R is a commu- 
tative ring with identity (see 0, page 117). A natural example here is V = R n which is the 
n-dimensional vector space over the reals. 

4. Let M be the matrix ring M n (R). 

This ring admits two alternate interpretations: 

(a) M = homR(V): M is the ring of all module-homomorphisms over V (see 0, p330). 

(b) M = V£: M is a group ring built from the ring V and the abelian group Q. 



Note the matrix ring and the group ring interpretations are not algebraically equivalent since 
the former is not a commutative ring while the latter is. A standard example here is M = 
M n (R) or the set ofnxn real matrices. 

5. Let T be the group ring MQ ^ hom R (V)<?. 

A main example is the set of n x n x n tensors over the reals. 

We will denote a convolution in a group ring generically by •. Note this generic construction can 
be extended to arbitrary order tensors by letting R be a commutative ring of tensors with identity. 

3.1 Induced products 

We describe some additional products which are induced from the rings involved. 

• The natural product among tensors in T = honiR(V)^ is simply their (convolution) product 
in the group ring itself. This product recursively uses the composition map between module- 
homomorphisms in honiR(V). 

• A natural tensor-matrix product between elements of T and M can be defined as follows. Let 
• :TxM— >Mbea convolution between an element of T = honiR(V)t/ and an element of 
M = YG- This product recursively uses the module-homomorphism action on V in a natural 
way. Alternatively, we may view this tensor-matrix product as the (convolution) product in 
T since V is isomorphic to a collection of "constant" homomorphisms {(f) v : v € V}, where 
(f) v {x) = v, for all x € V. 

• A "scalar" product between a = ^2 r 3h-\r) e ^ m ^ ^ = Ss^sl s ) € M is defined as a 
mixed convolution aoI = a*I, where 

a*X = ^(^a r *X s )|<7), (11) 

g rs=g 

and the product a r * X s is a convolution in V (viewing a r € R as a r | lg) G V). 

Remark: Braman [1] used a ring anti-isomorphism </> of V (see O, page 330) to define the scalar 
product as a o X = 0(a) * X, where <j)(%2„ a ff |<?}) = X^o a 3l5 _1 }- This definition is equivalent 
to a o X = X ■ circ(a) and reflects the transposition present in the matrix multiplication. 

4 Unitary free module 

We prove some properties showing the interplay between the distinct products involving vectors, 
matrices and tensors, and show that M has a vector space structure over the underlying ring. 

Lemma 2 For any a, b £ V and any X £ M, we have 

ao(bol) = (a*b)oX (12) 

Proof By associativity of convolution, we have 

ao(boI) = a*(b*I) = (aib)*I = (a*b)oI, (13) 

which proves the claim. □ 
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Figure 4: The transposed basis 25 = {B g = \g)(0\ : g £ Z n } for the module M = YZ n with scalar 
product aol (used by Braman HI). A more natural but unsuitable basis is {B g = |0) (<?| : g £ Z n }. 



Lemma 3 For any tensor T £ T, vector a £ V a«<i matrix I € M, we /zave 

T*(aoI) = ao(T*I). 
Proof We use associativity and commutativity properties of convolution: 



T*(aoI) 



T*(a*X) 

(T * a) * X, by associativity 
(a * T) -k X, by commutativity 
a • (T * X), by associativity again 

ao(T*I), 



which proves the claim. 
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A natural basis for the group ring M = YQ is 25 = {B g = ly\g) : g € <7}, which in Dirac's 
notation is B g = \lg)(g\. But to show that M is a free module under the scalar product a o X, 
Braman f 1] showed that a transposed basis for M is more suitable. 

Theorem 4 The group ring M together with the scalar product a o X is a free unitary (left) V- 
module, where the basis is 25 = {B g = \g)(^g\ ■ g € G}- 

Proof We verify the unitary module properties of M = YQ with the scalar product aoI = a*X 

1 . Scalar product distributes over vector addition: 

ao(I + y) = aoI + aoF. (20) 

This follows by distributive law for convolution. 

2. Scalar product distributes over scalar addition: 

(a + b)oI = aoI + boI (21) 

This again follows by distributive law for convolution. 



3. Scalar product satisfies: 

ao(boI) = (a*b)oX (22) 

This follows from Lemma|2l 

4. Scalar product possesses an identity element: 

l v oI = l V iI = X (23) 

This follows since ly is the identity element of the group ring V = RQ. 

To show that M is a free module, we show that 53 is a basis for M. We prove that for any matrix 
IeM, there are vectors &£ G V so that X = J2 £ a.£ o Bg. We have 

(j\X\k) = (j\J2(ae* B e)\k), by definition of a £ o^ (24) 

£ 

= (j\ \] ^_J(a^)fei-i J5^|i), by definition of convolution (25) 

£ i 

= 0'EZ}te)«-i|*>(M*>. by definition of B t (26) 



= (a,-)*- (2V) 

Thufl define a £ so that (a e ) k = (£\X\k). D 

5 Isomorphism 

In this section, we show that the set of tensors T is isormophic to the set of module homomorphisms 
over the module of matrices M. As proved by Braman [1], this generalizes the fundamental connec- 
tion between the set ofnxn matrices and the set of linear transformations over an n-dimensional 
vector space. 

Theorem 5 Let Q be an abelian group and R be a commutative ring with identity. Also, let V = 
RQ be a group ring and M = VQ be a free module with the scalar product a o X = a • X. 
If T = M n (R)Q is the group matrix ring, where M n (R) = honiR(V), then 

T ^ hom v (M). (28) 

Proof First, we show any tensor T € honiR(V)£? is a module homomorphism over M = YQ. Let 
A,B£YGandveY. Then, T*(A + B) = T* A + T-k B holds since convolution distributes 
over addition. Also, T * (v o A) = v o (T * A) holds by Lemma[3] This shows T G homv(Vty). 

Next, we show any module homomorphism L S homy (M) has a representation as a tensor T € 
T. By TheoremU {B g = \g){lg\ : g € Q} is a basis for the module M. Now, let L G hom v (V£) 
be so that its action on the basis element B^ is defined by 

L(B h ) = ^ (Xg,h o B g , where <x g>h G V. (29) 



'Using the natural basis Bg = |lg){^| in Equation 1261 . yields the degeneracy (j\X\k) = (%2 e (sli )ki- 1 ) (j | lg } . This 
allows only the first row of X to be defined. 



Then, for any A G M with A = ^2 h£ g ah ° Bh, we have 

L(A) = L(J2 a h oB h ) = J2 L{a h o B h ) = J^ "h ° L(B h ), (30) 

heg heg heg 

since L is a module homomorphism over M = VQ, Therefore, 

L{B h )\k) = ^2,a^ h -kBj\k), by equation d29]) (31) 

jeg 

= 2_\ Z_,( a j,h)ki- 1 Bj\i), by definition of convolution (32) 

jeg ieg 

= ^2( a j,h)k\j), since .Bj = \j)(lg\. (33) 

jeg 

Scq define a tensor T G honiR(V)0, where T = ^2keg Tk\k) so that the action of the homomor- 
phism Tfc on the basis element \h) of V is given by 

T k (\h)) = J>;,h)fc|j). (34) 

3 
So, L{Bh) and T * Bh are the same homomorphism (or matrix), since for each k: 

(T*B h )\k) =Y,T M -i(B h \l)) = Y, T M-i(\h)(lg\£)) =T k (\h)) (35) 

ieg ieg 

Therefore, using Lemma we have 

T*A = Y,T*{a h oB h ) = Y j aho{T*B h ),= Y,ahoL{B h ) = L(A). (36) 

heg heg heg 

This completes the isomorphism between honiR(V)^ and homv(V^). D 

6 Diagonalization 

This section shows that the eigenvalues and eigenvectors of a tensor can be recovered provided we 
are given a diagonalizing equation for the tensor. Although the theorem does not provide a method 
to diagonalize a tensor, it shows that there is a familiar underlying eigenvalue-eigenvector equations 
that can be extracted from the diagonalizing equation. 

A module-homomorphism L G honiR(V) is called diagonal if for all basis elements \k) of 
the group ring V, we have L(\k)) = £ k * \k), for some £\~ G R. A tensor V G homR(V)£7 is 
called diagonal if V = Ylqec D g \g), with each D g being diagonal. We use juxtaposition to denote 
composition of maps. 



2 Using the natural basis Bj = |lg){j| in Equation J32t . leads to the degeneracy L(Bh)\k) — (£2 •(Qj,fe)fej-i)|le)- 
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Figure 5 : Tensor diagonalization and the eigenvalue-eigenvector equations. 



Theorem 6 Let T = ^2 q T g \g), X = ^ X g \g), and £ = ^ L g \g) be tensors in T. Also, assume 
that £ is diagonal with L g (\k)) = r g -k\k). For k € Q, let X^ ' £ M.and £ k>k £ Y be the following 
formal sums: 

X^ = ^X g (\k))\g), C kjk = J^r g \g), r g eR. (37) 

965 g&Q 

If T*X = X*£, then 

T*X^=C Kk oX^ k \ (38) 

for each k € Q. 



Proof Note for any h,k G Q, we have 

(T*X) h (\k)) = Y,T hg ^X g (\k)) = ^T hg -iX^ = (T*xM) 
geG g£G 

On the other hand, 

(X -kC)h(\k)) = y ^X hg -iL g (\k)), by convolution in T 
geg 

= y^X hg -i(r g * |fc)), by definition of L g 

g&Q 



h- 



2~] r g * X hg ~i(\k)), since X hg -i is a homomorphism 



g&G 



^2r g * X^ , by definition of X^ 



g&G 



(£h k *X^) h , by definition of £ kk . 



This shows that T * X^ =C kk o X^ k \ 
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(44) 
□ 
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7 Conclusions 

In this work, we generalized Braman's work JU where it was proved that third-order tensors are 
exactly the set of linear transformations over a module formed by second-order tensors (matrices) 
with scalars that are first-order tensors (vectors). Our generalization is based on viewing Braman's 
construction in an algebraic framework involving group rings. An advantage of this viewpoint is that 
the different circulant products used in flTJ arise naturally as multiplications in various group rings. 
This is because convolution is the natural multiplication in these group rings and a circulant-based 
tensor product is a convolution based on the cyclic group Z n . 

In our generalization, we are able to allow any abelian group Q to replace the cyclic group 
7L n (which defined the convolution), any commutative ring with identity to replace the field M of 
real numbers, and arbitrarily high-order tensors to replace third-order tensors provided they form a 
commutative ring. Within this algebraic setting, we also identified Braman's clever choice of the 
basis for the module of matrices, which is not the natural basis for the group ring. 
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